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Abstract — This paper is eligible for the student paper award. 
In this paper, we analyse asymptotically a new class of LDPC 
codes called Non-binary Hybrid LDPC codes, which has been 
recently introduced in [7]. We use density evolution techniques 
to derive a stability condition for hybrid LDPC codes, and 
prove their threshold behavior. We study this stability condition 
to conclude on asymptotic advantages of hybrid LDPC codes 
compared to their non-hybrid counterparts. 

I. Introduction 

Like Turbo Codes, LDPC codes are pseudo-random codes 
which are well-known to be channel capacity-approaching. 
LDPC codes have been rediscovered by MacKay under their 
binary form and soon after their non-binary counterpart have 
been studied by Davey [1]. Non-binary LDPC codes have 
recently received a great attention because they have better 
performance than binary LDPC codes for short block length 
and/or high order modulations [3], [8], [4]. However, good 
short length non-binary LDPC codes tend to be 'ultra-sparse', 
and have worse convergence threshold than binary LDPC 
codes. 

Our main motivation in introducing and studying the new 
class of hybrid LDPC codes is to combine the advantages of 
both families of codes, binary and non-binary. Hybrid codes 
families aim at achieving this trade-off by mixing different 
order for the symbols in the same codeword. Our resulting 
codes are called Non-binary Hybrid LDPC Codes because of 
the mixture of different symbol sets in the codeword. 

In [7], we have demonstrated the interest of the Hybrid 
LDPC codes by designing codes that compare favorably with 
existing codes for quite moderate code length (a few thousands 
bits). Hybrid LDPC codes appear to be especially interesting 
for low rate codes, R < 0.25. In this paper, we study the 
asymptotic behavior and properties of Hybrid LDPC codes 
under iterative belief propagation (BP) decoding. 

The section two of this paper highlights the generality of our 
new codes structure, and explains why we have focused the 
asymptotic study on the particular subclass of linear codes. 
In third and fourth sections, we present the context of the 
study, and detail symmetry and linear-invariance properties 
which are useful for the stability condition. This condition is 
then expressed and analyzed to show theoretic advantages of 
Hybrid LDPC codes. 

'This work was supported by the French Armament Procurement Agency 
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II. The Class of Hybrid Codes 

We define a Non-binary Hybrid LDPC code as LDPC code 
whose variable nodes belong to finite sets of different orders. 
More precisely, this class of codes is not defined in a finite 
field, but in finite groups. We will only consider groups whose 
cardinality qk is a power of 2, that says groups of the type 
G(qk) = (51)^ with pk = log 2 (<7fc). Thus to each element 
of G(qu) corresponds a binary map of pk bits. Let us call the 
minimum order of codeword symbols q m i n , and the maximum 
order of codeword symbols q max . The class of hybrid LDPC 
codes is defined on the product group (^|) Pm " x . . . x 
(w,) PmaX ■ ^ et us n °ti ce that this type of LDPC codes built on 
product groups has already been proposed in the literature [2], 
but no optimization of the code structure has been proposed 
and its application was restricted to the mapping of the 
codeword symbols to different modulation orders. Parity check 
codes defined on (G(q m in) x . . . x G(q ma x)) are particular 
since they are linear in J|, but could be non-linear in the 
product group. Although it is a loss of generality, we have 
decided to restrict ourselves to hybrid LDPC codes that are 
linear in their product group, in order to bypass the encoding 
problem. We will therefore only consider upper-triangular 
parity check matrices and a specific sort of the symbol orders 
in the codeword, which ensures the linearity of the hybrid 
codes. The structure of the codeword and the associated parity 
check matrix is depicted in Figure [TJ We hierarchically sort the 
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Fig. 1. Hybrid codeword and parity-check matrix. 



different group orders in the rows of the parity-check matrix, 
and also in the codeword, such that q m in < ■ ■ ■ < qk < 
■ ■ ■ < q m ax- To encode a redundancy symbol, we consider 



each symbol that participates in the parity check as an element 
of the highest group, which is only possible if the groups are 
sorted as in Figure Q] This clearly shows that encoding is 
feasible in linear time by backward computation of the check 
symbols. 

In order to explain the decoding algorithm for hybrid LDPC 
codes, it is useful to interpret a parity check of a hybrid code 
as a special case of a parity check built on the highest order 
group of the symbols of the row, denoted G(qi) and have a 
look at the binary image of the equivalent code [8]. For codes 
defined over Galois fields, the nonzero values of H correspond 
to the companion matrices of the finite field elements and are 
typically rotation matrices (because of the cyclic property of 
the Galois fields). 

In the case of hybrid LDPC codes, a nonzero value is a 
function that connects a row in G(qi) and a column in G(qt), 
i.e., that maps the qk symbols of G(qk) into a subset of 
qk symbols that belongs to G(qi). Such application is not 
necessarily linear, but in the case it is, its equivalent binary 
representation is a matrix of dimension (pi x p^). Note that, 
with the above mentioned constraints, we have necessarily 
Pk < Pi- It is possible to generalize the Belief propagation 
decoder to hybrid codes, and it has been shown that even 
for those very specific structures, it is possible to derive a 
fast version of the decoder using FFTs [5]. In this work, we 
consider only maps that are linear applications, and hence that 
have a binary representation, in order to be able to apply all 
known results on linear codes. We call the message passing 
step through hij (cf. figure [2]i extension when it is from G(qk) 
to G(qi) and truncation when it is from G(qi) to G{qk). 




hn(ci) + h i2 {c2) + h i3 (cs) = 0, hij(cj) e G(qz) 
defines a component code in the group G — G(qi) X G(q2) X G{qs) 

Fig. 2. Parity-check of an hybrid LDPC code. 

III. Properties of Linear Hybrid LDPC Codes 

A. The Extension and Truncation Operations 

We first clarify the nature of the non-zero elements of the 
parity-check matrix of a hybrid LDPC code. We consider an 
element A of the set of linear extensions, from G(qk) to G(qi). 
lm(A) denotes the image of A. A belongs to the set of linear 
applications from G{2) Pk to G(2) Pi which are full-rank (that 



is injective since dim(Im(^4))=rank(A)=pfc). 

A: G{2) Pk -> G{2f l 
i -> j 

i denotes the binary map of i in G(qk) in G(2) Pk , with 
Pk = log 2 ((j , fc). That is, each index i is taken to mean the 
ith element of G(qk), given some enumeration of the field. 
Xi is the ith element of vector x. The extension y, of the 
probability vector x by A, is denoted by x xA and defined by: 
for all i = 0, . . . , qi — 1 

if i i Im(A), yi = 

if i 6 Im(A), yi = Xj with j such that i = Aj 

A is called extension, and the inverse function A" 1 trunca- 
tion from Im(A) to G(qk). The truncation is defined by 

A' 1 : lm{A) G(2) Pk 

j — > i with j such that j = Ai 

The truncation x of the probability vector y by A" 1 is denoted 
by y xA and defined by 

i = 0, . . . , qk — 1, Xi = yj with j such that j = Ai 

Given a probability-vector x of size q, the components of 
the logarithmic density ratio (LDR) vector w associated with 
x are defined as Wi = log (f 1 ) , i = 0, . . . ,q — 1. 
At channel output, LDR messages are actually logarithmic 
likelihood ratio (LLR) vectors. 

B. Parameterization of Hybrid LDPC family 

An edge of the Tanner graph of an Hybrid LDPC code 
has four parameters (i, qu,j, qi). A hybrid LDPC code is then 
represented by n(i,j,k,l) which is the proportion of edges 
connecting variable nodes of degree i in G(qk), to check 
nodes of degree j in G(qi). Thus, hybrid LDPC codes have a 
very rich parameterization since the parameter space has four 
dimensions. 

C. Symmetry definition for density evolution approach 

Let W be a LLR vector computed at the output of a discrete 
memoryless channel, and v the component of the codeword 
sent, corresponding to the required value for the data node 
the edge with message W is connected to. W a denotes the 
cyclic-permutation of W. c denotes the value of the symbol 
linked to the edge with the message W, and y the available 
information on all other edges of the graph. VKf is the ith 
component of W a and is defined by W" = log ( p^^j^j ^ , 
where • denotes the multiplication in G(q). Like in [4], W a , 
for all a <E G(q) is defined by 

W? = W a+l - W a , Vi = 0...g-1 

A channel is cyclic if output LLR vector W fulfills 

P(W a \v = 0) = P(W\v = a) 



Definition 1 On a cyclic channel, a LDR message is symmet- 
ric, if the following expression holds 

Va G G(q), P(W = w\v = a) = e- w «P(W = w\v = 0) 

Most practical channels are cyclic, and thus, in this work, 
we assume transmission on arbitrary memoryless cyclic- 
symmetric channels. The generalization of the results in this 
paper to non-symmetric channels can be done thanks to 
the coset approach as in [4]. The symmetry property is the 
essential condition for any asymptotic study since it ensures 
that the error probability is independent of the codeword sent. 
Lemma 1 : If W is a symmetric LDR-vector random variable, 
then its extension ~W xA , by any linear extension A with full 
rank, is also symmetric. 

The same lemma holds for truncation. The data pass and the 
check pass of belief propagation have already been shown 
to preserve symmetry. Thus, lemma 1 ensures that the hybrid 
decoder preserves the symmetry property if the input messages 
are symmetric. 

Lemma 2 : The error-probability of a code in a hybrid family, 
used on a cyclic-symmetric channel, is independent on the 
codeword sent. 

For lack of space, we do not give the proof of this lemma, 
which is a direct generalization of [6]. 

D. Linear Application-Invariance 

Now we introduce a property that is specific to the hybrid 
codes families. Bennatan et al. in [4] used permutation- 
invariance to derive a stability condition for non-binary LDPC 
codes, and to approximate the densities of graph messages 
using one-dimensional functionals, for extrinsic information 
transfert (EXIT) charts analysis. The difference between non- 
binary and Hybrid LDPC codes holds in the non-zeros ele- 
ments of the parity-check matrix. Indeed, they do not corre- 
spond anymore to cyclic permutations, but to linear extensions 
or truncations, that we denote by linear applications. The goal 
is to prove that linear application-invariance (shortened by LA- 
invariance) of messages is induced by choosing uniformly the 
linear extensions which are the non-zero elements of the hybrid 
parity-check matrix. In particular, LA-invariance allows to 
characterize message densities with only one scalar parameter 
[7]. 

We work with probability vector random variables, but all the 
definitions and proofs given in the remaining also apply to 
LDR-vector random variables. We denote by E the set of 
linear extensions from G(q\) to Gfa), and by T the set 
of "inverse functions" of E, what we call the set of linear 
truncations from G(q2) to G(q±) (see previous section on 
linear extensions). 

Definition 2 : Y is LA-invariant if and only if for all 
(A" 1 , B~ l ) ETxT, the probability-vector random variables 
Y xA ~ andY xS ~ are identically distributed. 
Lemma 3 : If a probability-vector random variable Y of size 
<72 is LA-invariant, then for all G G{q^) x G{q2), the 

random variables Yi and Yj are identically distributed. 
Definition 3 : Let X be a q\ -sized probability-vector random 



variable, we define the random-extension of size q2 of X, 
denoted X, as the probability-vector random variable X xA , 
where A is uniformly chosen in E and independent on X. 
Lemma 4 : A probability-vector random variable Y is LA- 
invariant if and only if there exists a probability-vector random 
variable X such that Y = X. 

For lack of space reason, we will detail the proof of this 
lemma, which is easy, in a future publication. Thanks to lemma 
4, the check node incoming messages are LA-invariant in the 
code family made of all the possible cycle-free interleavers and 
uniformly chosen linear extensions (and hence corresponding 
truncations). Moreover, random-truncations, at check node 
output, ensures LA-invariance of variable node incoming mes- 
sages. Thus, as shown in [7] under Gaussian approximation, 
the densities of vector messages are characterized by only one 
parameter. 

IV. The Stability Condition for Hybrid LDPC 
Codes 

The stability condition, introduced in [6], is a necessary 
and sufficient condition for the error probability to approach 
arbitrarily close to zero, assuming it has already dropped below 
some value at some iteration. In this paragraph, we generalize 
the stability condition to hybrid LDPC codes. 
Given a hybrid family defined by ir(i,j,k,l), we define the 
following family parameter: 

n = ^>(z = 2,fc,j,0^^(j-i) 

j,k,l qi 

Also for a given memoryless symmetric output channel with 
transition probabilities p(y\x) and a mapping £(•), we define 
the following channel parameter: 

1 r 

A = £V(k,i)— / y/p(v\s(i))p(y\s(o))dy 

k,l qi i=l 

E.g., for BI-AWGN channel, we have 

1 qk ~ 1 1 
A = ]T^(Z,fc)-— - J2 expi-^n,) 

l,k ql i=l 

where rii is the number of ones in the binary map of i G G(qk). 
Theorem : Let assume (it, 8) given for a hybrid LDPC set. 
Let Po denotes the probability distribution function of initial 
messages R.W for all k. Let Pj = P e (R t ) denotes the 
average error probability at iteration t under density evolution. 

• If il > t, then there exists a positive constant £ = 
£(7T,Po) such that P* > £ for all iterations t. 

• If SI < ^, then there exists a positive constant £ = 
£(7T, Pq) such that if P* < £ at some iteration t, then 
P* approaches zero as t approaches infinity. 

For lack of space reason, we give there only a sketch of the 
proof. 
Proof 

• We first give the general lines of the proof of the 

(k) 

necessary condition. Let RJ + „ denotes the variable node 



outcoming messages in G(qk) at iteration t + n, where 

n = 0, 1, Since we consider only cyclic-symmetric 

channels, we can apply lemma 4 from [4]. It ensures that 
there exists an erasurized channel such that the cyclic- 
symmetric channel is a degraded version of it, and hence 
provides a lower bound on the error probability. Let 



(k) 

R.j +rl , n = 0, 1, . . ., denote the respective messages of the 
erasurized channel, and e the erasure probability. In the 

remainder of the proof, we switch to log-density repre- 

* (*0 

sentation of messages. Let R' t+rl denote the LDR-vector 



representation of R 



t-J-n> 



0,1, 



Qri\vr) denotes 



the distribution of R' t+n . P denotes the distribution of 
the initial message R q of the cyclic-symmetric channel. 
The overline notation X applied to vector X represents 
the vector resulting from random extension followed by 
random truncation of X. Provided that random extension 
and truncation are such that X and X are of same size, 
we can show that the error p robabil ities are equal. Thus, 



if Q« is the distribution of R't +n , we have 



- (fc) 



Pe(Qn) 



£>(fc)P e (Q! fc) ) =5>(A0Pe(Q£>) 



Therefore P e (Q n ) is lower bounded by a constant strictly 
greater than zero if and only if there exists k such that 

P e (Q,n) is lower bounded by a constant strictly greater 
than zero. Defining 



n k = J2 7r(i = 2,j,i\k) 



J>-2,1 



qi-l 



U 1) 



and 



Po = J2k n (k)Po k \ we show that 



Pe(Ql fc) ) > 



1 



2 C 



wW-ipT 1 



(i) 



We prove that Pq is symmetric in the binary sense, and 
as in [4], we obtain 

lim - log P^(Wi < 0)®" = log ( E ( -Ir[ 
jwoo n \ \ 2 

where R[ is the shortened notation for the first component 
of the mixture of decoder input LLR-vector random 
variables R'n . We have 



-\R'i ) 




xAxB- 1 



xAxB 



-\AB 



and finally obtain 
and 



k.l 



( = 1 




i/^ J = / vWii* 



Hence, we find E (— ^P'i) = A. This last equation 
combined with equation ([T]i leads to the conclusion that 

Pe{Qn ) is lower bouded by a strictly positive constant, 
as n tends to infinity, as soon as f2A > 1. This condition 
is the same for all k. Thus, the necessary condition for 
stability is fl < j^. 

We give now the main steps for the proof of the suffi- 
ciency of the condition. X' fc ) denotes a probability-vector 
random variable of size k. We define D n and D a : 



Dn(XW) 



(k)\ _ 




To shorten the notations we can omit the index of iteration 
t. The data pass is translated by 



P W = R 



(0)< fe ) W r( fe ) 



We obtain 



D n (R t ) 



( 



It. 



ik) 



IK 



First, we are going to prove the recursive inequality (ff]) 



We show the three following equations. 

3 



L 



(k) 



\4 



(k) 



D„(L<*>) = X>(i|*)^A,(L< l >) 
i ® 



1 - D a (L®) > Ej 7t(jI0(1 - DaiR^y- 1 
+0(D a (RW) 2 ) 

Connecting D a (R^ l ' > ) to D n (R t ) ends up with the proof 
of equation |2 



1 ?fc_1 / 

p n (R t ) = 5>(o— T ^7r(fcio E E U 

i ® k i=l \\ 
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we obtain 



D n (R t ) = Y,Al)D a (R {l) ) 



D n (R t+1 ) < A^7r(i,fc) 



1 Ql \ ^ 2 ) 



+ 0(D n (R t 



(2) 



We express D a (R^) in terms of £>„(R t ): 
l-D a (RW) < l-nunD a (R«)<l-/3tD B (Rt) 

as soon as fit is a function of the iteration such that 

Pt < ""'d^r^'"' - Thus ' we obtain equation ©. 
We then can prove that if O < ^ then there exists a 
such that if Z3 n (R to ) < a at some iteration to, then 
Hindoo D n (R t ) = 0. Moreover, if X' fe ' is a symmetric 
probability-vector random variables of size qu, then 

^D n (X^) 2 < P e (XW) < (q k - l)fl n (X«) (3) 

Let us remind that D n (R t ) = ^ fc 7r(/c)D n (R( fc - ) ), and 
that the sequence £>„(R t )^ to converges to zero. Thus for 
all k, the sequences 7J„(R( )^ (q also converge to zero. 
And hence P e (Rj fc ' ) ) converges to zero. This is true for 
all k, and since we have P e (R t ) = ^ fc 7r(fc)P e (R^), 
-Pe(Rt) also converges to zero. This proves the suffi- 
ciency of the stability condition. 

□ 

Thus, we have proved that, provided that a fixed point of 
density evolution exists for hybrid codes, this point can be 
stable under certain condition. Our hybrid codes have hence 
threshold behavior. 

V. Analysis of the Stability Condition 

Now we are able to compare the stability conditions for 
hybrid LDPC codes whose highest order group is G(q) and for 
non-binary LDPC codes defined on the highest field GF(q). 
To illustrate advantages of hybrid codes over non-binary codes 
concerning the stability, we consider on figure [3] a code rate 
of one half, achieved by non-binary codes on GF(q), with 
q = 2 . . . 256, and hybrid codes of type G(2) — G(q), hence 
with graph rate varying with q. The information part of hybrid 
LDPC codes is in G(2), and the redundancy in G(q). We 
assume regular Tanner graphs for those codes, with connection 
degree of variable nodes d v = 2. The connection degree of 
check nodes will be hence varying whith the graph rate for 
hybrid codes. We consider BI-AWGN channel whose variance 
a 2 is set to 1. We denote by fl n b and ilf ly b the parameters of 
GF(q) LDPC codes and hybrid LDPC codes, respectively. 
The same for A n t, and A/ ly b. 

Remark 1 : We note, on figure [3] that flhyb < &nb an d 
A/ ly b < A n (, . Hence, with those assumptions, a fixed point 
of density evolution is stable at lower SNR for hybrid codes 
than for GF(q) codes. 

Remark 2 : For a usual non-binary GF(q) LDPC code, the 
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Fig. 3. Channel and code parameters A and Q for hybrid and non-hybrid 
codes in terms of maximum symbol order q. These figures show that a hybrid 
code can be stable when a non-binary code is not. 



hybrid stability condition reduces to non-hybrid stability con- 
dition, given by: 

n nb = p'(i)A'(o) 

A„ 6 = — — J^expi-—^ Hi) 

1 i=i 

with rii, the number of ones in the binary map of i G G(q). 
Under this form, we can prove that A„f, tends to zero as q 
goes to infinity. On BI-AWGN channel, this means that any 
fixed point of density evolution is stable as q tends to infinity 
for non-binary LDPC codes, and for hybrid codes too (because 
of Remark 1). 

Those results indicate that optimization procedures will be 
more efficient since there exist more stable hybrid codes than 
non-hybrid LDPC codes for a given set of channel and code 
parameters. The optimization and code design is reported in a 
future application. 
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